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Abstract 


This  note  describes  a general  method  for  discriminating 
between  two  k-dependent  stationary  discrete  random  vari- 
ables using  marginal  statistics  and  their  first  order 
correlations . 


Asymptotically  Optimal  Detector  of  Memory  p 
for  k - dependent  Random  Signals 


Lee  K.  Jones 


A stationary  discrete  time  series  {X^}?_^  is  said  to  be 
k-dependent  if  for  every  integer  m,  {X>^<  m is  independent  of 
^i^i>k+m‘  Suppose  {X^}  and  {X^}  are  two  stationary  k-dependent 
random  signals  occurring  with  prior  probabilities  o and  1-a  re- 
spectively. If  n pulses  of  a random  signal  are  observed  (n 
large  compared  to  k)  how  do  we  decide  whether  we  observed 

? 


A detector  L of  memory  p is  given  by  a function  L(X)  = 

n 


L(x1,  x2,  ....  xn)  = 2 g^Xj,  xi-i»  •••*  xi_p)  and  a set  A 

i=p+l  ^ 

of  real  numbers  such  that: 

for  L(X)  e A we  choose  class  1 
for  L(X)  e Ac  we  choose  class  2 

In  view  of  the  stationarity  we  need  only  consider  (for  n large 

compared  to  p)  detectors  for  which  g^  = g for  all  i. 

1 2 

Suppose  both  {X^}  and  {X^>  are  bounded  with  known  (or  esti 
mates  of)  statistical  properties  (correlations,  moments,  etc.). 
In  this  note  we  use  a straightforward  extension  of  the  method 


(1) 


of  minimal  marginal  moment  variance'-  1 to  determine  the  g which 


(2) 


(1)  For  the  cases  we  shall  consider,  A is  the  union  of  one  or 
two  intervals. 


(2)  Introduced  in  [2]  to  solve  for  the  case  p*0,  k*0. 

1 


1 


minimizes  the  probability  of  error.  This  solves  the  problem  ad- 

1 2 

dressed  in  [11  (p-0,  Xj-O+n^,  x^«»n^,  n^  k-dependent) . 

Solution:  Let  1,  h^ , h2,  ...  be  a complete  set  of  contin- 
uous functions  on  Rp+1.  For  g • yj  a.;h.  we  find  the  coefficients 

q i J J 

a^  which  minimize  the  probability  of  error.  The  constant  func- 
tion 1 need  not  be  present  in  this  expansion  since  it  trivially 
has  the  same  statistical  properties  under  both  hypotheses.  As 
q becomes  large  the  error  probability  using  converges  to  the 

error  probability  for  the  optimal  g. 

n 

Consider  L(X)  - T g_  (x. , x.  ...,  x.  ).  It  is  a 
i-p*l  q 1 1 1 1 p 

sum  of  bounded  k+p  - dependent  random  variables.  Hence  L is  as- 


ymptotically normal  under  each  hypothesis.  The  set  A will  in 
general  be  described  by  2 thresholds.  (If  a single  threshold 
detector  is  desired  the  following  analysis  remains  the  same.) 

Let  £(aj)  - probability  of  error  - */“  min  (apj,  (l-a)p2) 
dx  where  p^  is  the  probability  density  of  L under  hypothesis  i. 

By  normality  pj  and  p2  are  characterized  by  their  means  and  vari- 
ances. We  now  restrict  a^  such  that  F<2  L(X)  - Ej  L(X)  - 1.  £ is 

then  a function  of  the  variances  of  L under  each  hypothesis: 

£*£(v,(a.),  v9(a-)).  Taking  the  gradient  wrt  a.  and  using  X 
A j L J j 

as  a Lagrange  multiplier  we  have: 


if-  Vt1  *3^  7v2  - - E1L»  • 0 


(1) 


2 


The  partials  may  be  negative  (even  for  a single  threshold  de- 
vi 

tector)  but  are  not  both  zero.  It  is  easy  to  see  that  a solution 
of  (1)  is  a critical  point  of  the  objective  function  8vi  ♦ 

(1  - | 3 1 ) V2  - * (E2L-E1L-I)  where  # is  a Lagrange  multiplier  and 
'1  Ji  8 1 ♦ 1.  This  critical  point  may  be  determined  for  various 
values  of  8 and  the  8 corresponding  to  minimum  probability  of 
error  determined  from  normal  tables. 

We  now  proceed  with  the  calculations.  Let 


hj  ■ hj(xi"  xi-l*  ••••  xi-p) 
eijs  ' Bifol  - Ei  <hs 


!1  hs“)] 


By  differentiating  the  above  objective  function  wrt  a^  and  set- 
ting the  result  equal  to  zero  we  obtain: 


[0  Ax  + (1-|8|)A2J  a * -j-  (n-p)  m 


where  m-  = E?h^  - E,h^ 
J ^ J L J 


and  (At)js  = (n-p)p9.s  . £ Cn-p-U  (p9js  * p‘sj) 


Solving  equation  (2)  - 


a = 4>  (2^2.)  + (1- 1 8 1 )A2j  1 m = $ g£ 


Then 


— - 1 

4>  = ( 2 Be*  m-)  from  the  condition  E2L-E.L=1. 
j=l  J 


3 


Vj  and  v2  may  now  be  calculated  and  the  error  (as  a function  of 
6)  determined.  The  6 corresponding  to  minimum  error  is  then 
obtained  by  a one-parameter  minimization.  The  preceding  method 
will  yield  an  optimal  detector  whenever  the  p^  occurring  in  the 
expression  for  G(a^)  depend  only  on  the  means  and  variances  of 
L.  We  need  only  estimate  the  error  as  a function  of  6 from  the 
performance  of  L on  sample  data. 


♦ 
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